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Abstract —Quantitative analysis of the dynamics of tiny cellular 
and sub-cellnlar strnctnres, known as particles, in time-lapse 
cell microscopy sequences requires the development of a reliable 
mnlti-target tracking method capable of tracking nnmerons 
similar targets in the presence of high levels of noise, high target 
density, complex motion patterns and Intricate Interactions. In 
this paper, we propose a framework for tracking these structures 
based on the random finite set Bayesian filtering framework. 
We focus on challenging biological applications where image 
characteristics snch as noise and background intensity change 
dnring the acquisition process. Under these conditions, detection 
methods usnally fail to detect all particles and are often followed 
by missed detections and many spnrious measurements with 
nnknown and time-varying rates. To deal with this, we propose 
a bootstrap filter composed of an estimator and a tracker. The 
estimator adaptively estimates the required meta parameters for 
the tracker such as clutter rate and the detection probability of 
the targets, while the tracker estimates the state of the targets. 
Onr resnits show that the proposed approach can ontperform 
state-of-the-art particle trackers on both synthetic and real data 
in this regime. 

Index Terms —Mnlti-target tracking, particle tracking, fluores¬ 
cence microscopy, Bayesian estimation, random finite set, CPHD, 
clntter rate, detection probability. 

I. Introduction 

T he ability to accurately monitor cellular and sub-cellular 
structures in their native biological environment has enor¬ 
mous potential in addressing open questions in cell biology. In 
various applications, one of the key steps for understanding bi¬ 
ological phenomena is to assess the motion of these structures. 
Recent developments in time-lapse cell microscopy imaging 
systems have had a great impact on the analysis of these 
dynamics. However, visual inspection of sequences acquired 
by these imaging techniques requires manual tracking of many 
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Fig. I. Two images of a TIRFM sequence visualizing fluorescently tagged 
vesicles (bright spots) close to the plasma membrane of a pancreatic beta cell 
(a) before and (b) after injection of insulin. Clearly, the background intensity 
and noise level noticeably increase during the acquisition. 


tiny structures in numerous noisy images. Thus, automated 
multi-target tracking methods have been extensively used in 
different biological applications in the last decade ll ■ 


m- 


Despite significant technical advances made in automati¬ 
cally tracking movin g ob jects, tracking microscopic structures, 
known as particles 12611 . remains a challenging task due to 
the complex nature of biological sequences. The microscopic 
sequences are usually populated with similar tiny structures 
having intricate motion patterns and sophisticated interactions 
with other structures. Moreover, the structures may enter or 
disappear from the field of view or be occluded by other 
objects. In addition in some imaging techniques, i.e. fluores¬ 
cence microscopy imaging, the sequences are contaminated 
with a high degree of noise. Under these conditions, detection 
methods usually fail to detect all particles and generate many 
spurious measurements (clutter) il4 12711 . To be successfully 


applied in many biological applications, multi-target tracking 
methods should be able to track an unknown and time-varying 
number of similar particles in the presence of clutter and 
detection uncertainty. 

To this end, many particle tracking approaches have been 
proposed in literature iffl]. Some of the most popular 
particle tracking approaches are based on detection followed 
by a deterministic linking procedure. Here, each particle is sep¬ 
arately detected in each frame. Then, a deterministic solution, 
e.g. an optimization technique, links the corresponding targets 
between frames . The performance of these algorithms is 
often sensitive to the detection algorithm and may degrade in 
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the presence of complex target dynamics and highly cluttered 
detections resulting from very noisy sequences. 

Bayesian filtering approaches are another class of tracking 
algorithms that have become popular for particle tracking 
applications in recent years ild424ll . These approaches better 
deal with tracking multiple particles in cluttered measurements 
by incorporating prior knowledge of target dynamics and mea¬ 
surement models 1 14-1^. However, knowledge of the clutter 
rate and detection profile of the chosen detection method, are 
of critical importance in Bayesian multi-target tracking. 

Most existing multi-target tracking solutions assume known 
and fixed detection and false alarm parameters. However, 
these parameters cannot be computed in many practical ap¬ 
plications and worse, it is not even known whether they are 
time-invariant. In biological imaging techniques, the noise 
characteristic and the background intensity of sequences may 
change during the acquisition process which make detection 
profile and clutter rate time-variant. For instance, injection of a 
stimulus such as insulin into pancreatic beta cells increases the 
noise level and overall intensity of the sequences acquired by 
total internal reflection fluorescence microscopy (TIRFM) 11281] 
(Fig. m- Thus, the ability of multi-target trackers to accom¬ 
modate unknown clutter and detection parameters is crucial in 
time-lapse cell microscopy since mismatches in these model 
parameters inevitably result in erroneous tracking outputs. 

The key contribution of this paper is to propose an effective 
solution to the problem of tracking multiple maneuvering par¬ 
ticles in unknown and time-varying false alarm and detection 
rates. To the best of our knowledge, this practical problem 
has not been discussed in the biological signal processing 
literature so far. To address this challenging problem, we use 
the recent generation of Bayesian filters based on random 
finite set theory. This framework provides an elegant math¬ 
ematical formulation for multi-target systems and allows us 
to deal with the aforementioned complexities. Our proposed 
approach is based on the Cardinalized Probability Hypothesis 
Density (CPHD) filter for unknown clutter rate and detection 
profile known as the A-pu-CPHD filter Clutter rate and 
detection probabilities are estimated by the A-p^-CPHO filter 
bootstrapped onto a CPHD filter that outputs target estimates. 
This bootstrap idea was inspired by S which requires known 
and uniform probability of detection. Our proposed solution 
can accommodate unknown and non-uniform probability of 
detection. To cope with maneuvering motion of sub-cellular 
structures 11614211 . we also propose the multiple model imple¬ 
mentation of the aforementioned filters in this paper. We will 
show that the proposed method is able to deal with tracking 
maneuvering structures in the presence of unknown and time- 
varying clutter rate and detection profile. 


H. Background 

The Bayesian estimation paradigm deals with the problem 
of inferring the state of a target from a sequence of noisy 
measurements. The state vector contains all relevant dynamic 
information about the target while the measurements contain 
what can be directly observed from the sequences. The notion 
of Bayes optimality is fundamental to the Bayesian estimation 


paradigm and is well-defined for single-target tracking 1131 1. 
While Bayes optimal tracking techniques such as Kalman and 
particle filters are formulated for a single-target, they can 
be algorithmically extended to track a time-varying number 
of targets by combining them with data association 1132 - 


3411 . However, the notion of Bayes optimality does not carry 


over. Nonetheless this approach to multi-target tracking has 
been used in a wide range of applications, including particle 
tracking IHHIl. 

The random finite set (RFS) approach, introduced by Mahler 
generalizes the notion of Bayes optimality to multi-target 
system using RFS theory iH. The key difference with other 
approaches is that the collection of target states at any given 
time is treated as a set-valued multi-target state. This rep¬ 
resentation provides an elegant formulation for multi-target 
system which avoids the need for data association. The RFS 
approach has generated substantial interest in recent years 
with the development of the Probability Hypothesis Density 
(PHD) filter Q, Cardinalized PHD (CPHD) filter S, 
multi-Bernoulli filters ll3^ [ 3 ^. labeled RFS filter |39| and 
a host of many applications ll40ll including cell and particle 


tracking 11151-117 


A. RFS for multi-target tracking 

In the Bayesian estimation paradigm, the state and mea¬ 
surement are treated as realizations of random variables which 
are suitable for single target and single measurement system. 
However, in a multi-target system, the collection of states and 
measurements can be naturally represented as finite sets. 

Let ..., ajfe 7 v(/c) ^fc,M(fc) be the states of 

all N{k) targets and all M{k) measurements at time k, 
respectively. Over time, some of these targets may disappear, 
new targets may appear, and the surviving targets evolve 
to new states. Moreover, due to poor detector performance, 
only some targets are detected at each time step and many 
measurements are spurious detections (clutter). Thus, we can 
conveniently represent the targets and measurements at each 
time slice with two finite sets as 


Xk — {Xk,l, ■ • ■ , Xk^N(k)}: 


( 1 ) 


Consequently, the concept of a random finite set (RFS) is 
required to cast the multi-target estimation problem in the 
Bayesian framework. Intuitively, an RFS is a finite-set-valued 
random variable. What distinguishes an RFS from a random 
vector is that the number of constituent variables is ran¬ 
dom and the variables themselves are random, distinct and 
unordered. Mahler’s Finite Set Statistics (FISST) provides 
powerful yet practical mathematical tools for dealing with 
RFSs based on the notion of integration and density 

that is consistent with point process theory 114ill . The center- 
piece of the RFS approach is the so called Bayes multi-target 
filter, a generalization of the single-target (optimal) Bayes 
filter to accommodate multiple targets based on multi-target 
dynamic and measurement models. 
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1) Multi-Target Dynamical Model: Given a multi-target 
state Xk-i at time fc — 1, each target Xk-i € ^fc-r either con¬ 
tinues to exist at time k with probability and moves 

to a new state Xk with probability density fk\k-i{xk\xk-i), 
or dies with probability 1 —ps,k {xk-i) and takes on the value 
0. Thus, given a state Xk-i € Xk-i at time fc — 1, its behavior 
at time k is modeled by a Bernoulli RFS, 5'fe|fe_i, which has 
FISST densitjQ given by 

f l-ps,k(^k-i) ifS'fc|fc_i=0 , (2) 

1 PS,k{^k-i)fk\k-l{xk\xk-l) if Sk\k -1 = {xk}- 

Assuming that individual targets move independently, each of 
the above Bernoulli RFSs are mutually independent condi¬ 
tioned on Xk-i- Thus the survival or death of all existing 
targets from time fc — 1 to time k is modeled by the multi- 
Bernoulli RFS 

Tkik-iiXk-i) = u ^k\k—l (xk-i). (3) 

The appearance of new targets at time k is modeled by an 
RFS of spontaneous births F^ which is usually specified as 
an i.i.d. cluster RFS with intensity function -fk and cardinality 
distribution pr, JE Consequently, the RFS multi-target state Xk 
at time k is given by the union 


Xk = Tk\k-i{Xk-i) UTk- (4) 


The likelihood of the multi-target state Xk, at time 
k, is described by the multi-target transition density 
fk\k-i{^k\Xt-i) which incorporates target dynamics, births 
and deaths ll^ . 

2) Multi-Target Measurement Model: Given a multi-target 
state Xk at time k, each target Xk € Xk, at time k, is 
either detected with probability pD,k (xk) and generates an 
observation Zk with likelihood gkizk\xk), or missed with 
probability 1 —pD,k {xk) and generates the value 0, i.e. each 
target Xk € Xk generates a Bernoulli RFS, Dk, which has 
FISST density given by 


Pk{Dk\xk) 


^—PD,k{xk) if Dk=<l>, ,,, 

PD,k{xk')gk(,Zk\Xk') if Dk — 


The set of measurements generated by Xk, at time k, is 
modeled by the multi-Bernoulli RFS 


0fe(2ffc) = [J Dk{xk)- 


( 6 ) 


Xk&Xk 


In addition, the sensor receives a set of false/spurious 
measurements or clutter, modeled by an RFS Kk, which is 
usually specified as an i.i.d. cluster RFS with intensity function 
Kk and cardinality distribution pK,k 113111 . Consequently, at 


*For more detail on RFS density and probability density please see tsTIl 
^An i.i.d. cluster RFS can be statistically represented by its intensity and 
cardinality distribution. The cardinality distribution, p(n), provides a discrete 
probability distribution over the number of the constituent random variables, 
n, while the intensity distribution v{x) at the point x in the state space is 
interpreted as the instantaneous expected number of the variables that exist 
at that point tJIll . 


time k, the multi-target measurement Zk generated by the 
multi-target state Xk is formed by the union 


Zk = 0fc(2ffc) U Kk- 


(7) 


The likelihood of the multi-target measurement Zk, given 
the multi-target state, at time k, is described by the multi¬ 
target measurement likelihood gk{Zk\Xk) which incorporates 
detection uncertainty and clutter. 

3) Bayes Multi-Target Filter: The multi-target posterior 
density contains all statistical information about 

the multi-target state at time k and can be recursively com¬ 
puted by the aforementioned multi-target transition density and 
measurement likelihood using the following prediction and 
update equations. 

Pk\k-l{Xk\Zi-k-i) = 


J fk\k-liXk\Xk-l)pk-liXk-l\Zi.k-l)SXk-l, 


( 8 ) 


(9) 


Pk(,Xk\Zi-k^ OC gk^Zk\Xk^Pk\k — l{^k\Zl:k — l^, 

where f (■)SX is the set integral m. 

This filter generalizes the notion of Bayes optimality to 
multi-target system using RFS theory. Further details can be 
found in |3I]. 


B. The PHD filters 

Although the above framework provides an elegant 
Bayesian formulation of the multi-target filtering problem, it 
can be computationally expensive for applications with large 
number of targets S. In im, Mahler proposed to propagate 
the probability hypothesis density (PHD), or posterior intensity 
distribution, of the targets Vk{xk) which is the first statistical 
moment of the probability density function pk{Xk\Zi:k)- The 
primary weakness of the PHD filter is a loss of higher order 
cardinality information which causes erratic estimates in the 
number of targets especially when the density of targets is 

high lESJp. 

Mahler Ohil subsequently proposed the Cardinalized PHD 
(CPHD) filter which jointly propagates the posterior intensity 
function, Vk, and cardinality distribution, pk- The propagation 
of the cardinality distribution makes the filter more robust in 
the estimation of the number of targets ll3^ . 

As with all Bayesian filtering frameworks, this filter also 
requires some predefined models such as the single target 
Markov transition density fk\k-i{'\') for the dynamic model, 
measurement likelihood 5 fc(-|-) and probabilities of survival 
Ps,k{-) and detection pD,k{ )- Moreover, the models for new 
born targets and false alarms (clutter) are described by the birth 
cardinality distribution pr,fe and the birth intensity function 
7 fc, and the clutter cardinality distribution pK,k and the clutter 
intensity function Kk, respectively 0. Obviously, this filter 
requires knowledge of the detection probability and clutter 
distributions similar to other Bayesian filters. 

In 0291] . it was shown that the CPHD filter can also be 
reformulated such that it jointly estimates clutter distributions 
and detection probability while tracking. We refer to this 
version of the filter as the A-pu-CPHD filter. However, the A- 
P£)-CPHD cannot naturally perform as well as the CPHD filter 
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Pk 

Vk 


Fig. 2. A schematic of the proposed bootstrap filter. 


when exact knowledge of detection probability and clutter 
density is available. 

III. The Bootstrap CPHD Filter 
To propose an effective multi-target particle tracker for prac¬ 
tical applications with unknown and time-varying clutter rate 
and detection profile, we borrow the bootstrap idea proposed 
in M- However, in addition to the clutter rate, we calculate 
the detection probability, using the A-pu-CPHD filter, and feed 
these to a robust multi-target tracking filter such as the CPHD 
filter (Fig. |2]l. We use the CPHD filter for target estimation 
because it is a good trade-off between accuracy and speed. 
Nonetheless, it can be replaced by any multi-target filter that 
requires knowledge of false alarm and detection rate. In this 
paper, we assume that pD,k and the clutter distributions, pK,k 
and Kfc, are the meta parameters to be estimated for the CPHD 
filter in each time frame. However, we will show that the 
estimation of the mean of the clutter rate, Afc, is sufficient 
to uniquely define the pK.k and Kk- 

To deal with maneuvering dynamics, we assume that target 
motion can be characterized by multiple dynamic models. 
Thus, here, we propose the multiple model (or jump-Markov) 
implementation of both the CPHD and A-pu-CPHD filters and 
use these filters as the tracker and the parameter estimator, 
respectively. 


A. Multiple Model CPHD filter 

Complex maneuvering motions can be often characterized 
by multiple simpler dynamic models. The idea of tracking a 
target with multiple motion models is to augment the state of 
the targets by the index of the model ll43l] . 

For notational convenience, we remove the time index k in 
our formulation throughout the paper. However, the random 
variables and distributions are generally time-indexed. All 
random variables {■)k at time k and (Ofc-i at time fc — 1 are 
simply denoted by (•) and (•), respectively. 

Let X and TZ = {1, 2, • • • , i?} denote the kinematic state 
space and the multiple models state space, respectively. Define 
the augmented state space X_ — X x TZ, where x denotes 
the Cartesian product. The underscore notation is used for the 
augmented state space so that ^ = \x,r] C X_ denotes x X 
for the kinematic state and r € TZ for the model state. The 
integral of a function / : ^ ^ R is given by 


f(x)dx = 


lx 


R 

E 

r=l ‘ 


f{x,r)dx. 


( 10 ) 


A 


The measurement likelihood and probabilities of survival and 
detection for the augmented state vector can be respectively 
written as 

g(,z\x) = g{z\x,r), (11) 

Pg{x) =Pg{x,r), (12) 

Pjj{x) =Pjj{x,r). (13) 

Also, for the augmented transition density and birth intensity, 
we have the following factored forms. 


£{x\x) = f{x, r\x, r) = f{x\x, r)r(r|r), (14) 

l{x) = fix, r) = 7(a;)7r(r), (15) 

where T(r|r) is the probability transition from model r to 
r and 7r(r) is the probability of birth for model r ll43n . As 
described in Section im the filter also requires the knowledge 
of the birth cardinality distribution priji). 

Clutter is usually assumed to be Poisson RFS and indepen¬ 
dent from the target state EIlSi with 


Pk{ti) = Poisiri] A), 
k{z) = XlC{z), 


(16) 

(17) 


where IC{z) is a known probability distribution, e.g. uniform 
distribution, representing how the false alarms are distributed 
over the measurement space and f /C(z)dz = 1. Therefore, 
given lC(z), knowledge of the parameter A is sufficient to 
define the clutter distribution. 

Substituting the aforementioned augmented model terms 
(Eqs. flTIfTTl i into the conventional CPHD equations 14^ and 
using Eq. [TO] yields the recursive equations for the multiple 
model or jump Markov CPHD filter (see Appendix lAl). 

Pig. [3] depicts a simple graphical representation of the 
proposed multiple model CPHD filter. At each time step k, 
the intensity Vk and cardinality pk distributions are predicted 
and updated from the intensity Vk-i and cardinality pk-i 
distributions in the previous time step k — \ and using the 
augmented model terms (Eqs. [TTIfTTl i. The intensity distribu¬ 
tion provides information on the state of the targets while 
the number of targets can be estimated using the cardinality 
distribution. Specifically, the number of targets is estimated 
using the posterior mode = argmaxpfc(n) 1^ . Note 
that this filter requires the clutter rate A and the detection 
probability pu as prior knowledge. 


B. Multiple Model X-pD-CPHD filter 

We borrow a key idea from Mahler et al. ll29n to develop 
a multiple model CPHD filter with unknown clutter rate and 
detection profile. To estimate clutter, the idea is to model it 
as a random finite set of false targets which is statistically 
independent from the set of actual targets. These false targets 
are defined by their own models such as birth, death, survival 
and detection probabilities and transition model. Therefore, 
the multi-target state is composed of a disjoint combination of 
these two finite sets including actual targets and clutter. This 
hybrid multi-target state allows us to track both actual and false 
targets simultaneously. To deal with multiple model dynamics 
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with multiple clutter generators and non-uniform distribution 
is straightforward. 

In addition, since clutter generators are identical and the 
false targets do not follow any motion pattern, it is reasonable 
to ignore any functional dependence on the state of a clutter 
generator c, 02911 . As a result, the probabilities of survival and 
detection and the measurement likelihood for the hybrid and 
augmented state vector can be respectively written as 


Es© 


(t) / \ 

Ps 

( 0 ) 

4 > 


X e 


Ed© = 


a, 

b, i G 


( 20 ) 

( 21 ) 


Fig. 3. A schematic of the proposed MM-CPHD filter. 


and unknown detection probability, the state of targets are 
augmented by the index of the models and the unknown 
detection probability. Finally this hybrid and augmented state 
is estimated from the sequence of hnite sets of measurements 
generated by both real targets and clutter while accommo¬ 
dating multiple model dynamics and estimating the detection 
probability and clutter rate. 

Let denote the state space for actual targets, X^^^ 

denote the state space for clutter generators and X^^'> = [0,1], 
TZ = {1, 2, • • • , R} and Q — {1, 2, • • • , Q} denote the state 
space for the unknown detection probability, and the multiple 
models for actual targets and clutter, respectively. Dehne the 
hybrid and augmented state space as 

A = [x^^^ X X^^'^ X W {x^°^ X X^^^ X q) (18) 

where W denotes a disjoint union. The double dot notation 
is used throughout to denote a function or variable dehned 
on the hybrid state space and the underscore notation is used 
for the augmented state space. Therefore, x G represents a 
hybrid and augmented state such that x = {x, a, r) G = 
X(i) X X 7e and c = (c, b, q) G X^°'> = X^°^ x x Q 
denotes the actual and clutter states comprising the kinematic 
state and augmented components, respectively. The integral of 
a function / : ^ ^ R. is given by 


/ f{x)dx=/ / / f{x,a,r)dxda+ 

f{c,b,q)dcdb. (19) 


Q 

E 

9=1 ' 


'A(a) Jx(o) ' 


In theory, there may exist multiple model clutter generators. 
However, in most tracking applications, it is assumed that 
the clutter is uniformly distributed with Poisson cardinal¬ 
ity E- [3- As a result, multiple model clutter generators with 
uniform-Poisson distribution can be substituted by a single 
model clutter generator with uniform distribution and higher 
Poisson mean. Therefore, we continue our derivations with 
the single model clutter generators by eliminating the variable 
q from the equations. Deriving the equations for applications 


9 {z\x) 


g{z\x,r), X G 
/C(z), X G 


( 22 ) 


where /C(-) is clutter density which is often assumed to be 
uniform distribution in the measurement space. As the survival 
probabilities and the measurement likelihoods are independent 
from the detection probabilities, the terms a and b are removed 
from the equations. Obviously, the detection probabilities are 
only dependent on a and b. 

For the hybrid and augmented birth intensity and transition 
density, we have the following factored forms. 


7(x) = 


7 *^^^ (x, a)7r(r), x G 
7 ( 0 )(&), xGX^°'> 


(23) 


/(*ll) = 

f^^'>{x\x,r)f^^\a\d,r)T{r\f), x,x G 
/(°)(c|c), 

0, otherwise. 


(24) 


where /(^)(a|d,r) is the transition density for the detection 
probability a and /*'°^(c|c) = f^^\b\b) due to the indepen¬ 
dence of false alarms from the clutter state c. Furthermore, 
the cardinality distribution of birth for the hybrid space is 

pr = Pr ^ * Pr S- 

By substituting the hybrid and augmented state space model 
terms (Eas. l20l - l24l i into the conventional CPHD equations 0421] 
and using Eq. [19] the recursive equations for this biter can be 
calculated (see Appendix IbTi. 

Fig. |4| shows a simple graphical representation of the 
proposed multiple model A-pD-CPHD biter. At each time step 
k, the target’s intensity the clutter intensity u® and the 
hybrid cardinality distribution p^ are predicted and updated 
from the target’s intensity the clutter intensity x® and 

the hybrid cardinality distribution pk-i in the previous time 
step fc — 1 and using the hybrid model terms (Eqs. 120142411 . 

The posterior cardinality pk provides information on the 
total number of real and clutter targets. Therefore, the number 
of actual targets cannot be estimated using the posterior 
mode Nk = argmaxpfe(n), since pk{n) includes both real 
targets and clutter. In this biter, the posterior mean = 
(x, a, r)dxda is used for estimation of the number 















IEEE TRANSACTIONS ON MEDICAL IMAGING, VOL. 34, NO. 6, JUNE 2015 


6 


-D 




-o 
a> 
c 



Fig. 4. A schematic of the proposed MM-A-p£)-CPHD filter. 


of real targets t2% . Therefore, in contrast with the CPHD filter, 
this filter cannot benefit from propagation of the cardinality 
distribution for the estimated number of the targets. Similar to 
the PHD filter, this leads the erratic estimates of the number 
of targets which worsens the tracking result. To this end, we 
use this filter only as the estimator in our bootstrap filter. 
The estimated detection and mean clutter are respectively 
calculated as follows ll29n . 

... 

(25) 


PD,k 


) „(1) \ 
(0) „(o) 


X. \ 


where (•,•) is the inner product operator, p^]^\ = a and = b. 


.(0) 


IV. Experimental results 

To evaluate the performance of our proposed filters, we ap¬ 
ply them to multi-target tracking in 2-D Total Internal Reflec¬ 
tion Fluorescence Microscopy (TIRFM) sequences. TIRFM is 
an imaging technique that enables visualization of sub-cellular 
structures such as vesicles that are on or close to the plasma 
membrane of cells Q.The vesicles are very tiny sub-cellular 
structures and are seen in TIRFM sequences as small particles 
(bright spots) moving with varying dynamics. These small 
particles appear and disappear from the field of view and 
can be occluded by other structures. Due to limitations in the 
TIRFM acquisition process, the sequences are contaminated 
with a high level of noise. We consider the case where the 
main characteristics of the sequences such as noise level and 
the background intensity gradually increase over time (Fig.[T]). 

In this specific application, we are interested in the overall 
motion of the vesicles before and after injection of insulin, not 
motion of a single object. In this case, the primary concern 
is not how well a tracking approach maintains the identity of 
a tracked object over time. Instead, we are mainly concerned 
with how well a tracker avoids false and missed tracks. 

We compare the results of our bootstrap filter against those 
of several popular state-of-the-art particle tracking methods 


includini 

Tracker 


two reliable deterministic linking techniques, P- 
and U-Tracker (Utl, and two robust detection based 


traditional Bayesian filtering approaches, MHT 01411 and IMM- 
JPDA ifl^ FI Our results are also compared against the result 
of a multiple model PHD filter US. Finally, the results of our 
other derived filters such as the multiple-model CPHD (MM- 
CPHD) and A-p£,-CPHD (MM-A-pn-CPHD) filters are also 
reported here in order to show the efficiency of our bootstrap 
idea. 


A. Setup and Implementation Details 


To fairly evaluate the performance of all tracking algo¬ 
rithms, the same detection lists were provided for all compet¬ 
ing tracking methods. We chose the detector proposed in 11441] 
as it performs reliably in our synthetic and real sequences. 

Having ground truth, we can accurately calculate the clutter 
(false positive) and the detection probability (true positive rate) 
of the chosen detector for each time frame. True positive and 
false positive were calculated based on the optimal sub-pattern 
assignment between the ground truth and detected point sets. 
In this case, if the distance between two optimally assigned 
points is less than a predefined distance (2 pixel), the detected 
point is counted as true positive, otherwise it is a false positive. 

For the MHT, IMM-JPDA, MM-PHD and MM-CPHD 


filters, the average number of false detections per frame A and 
the mean value of the detection probability po (the optimal 
value for these parameters) were used as the predefined clutter 
rate and detection probability. However, accurate knowledge 
of these values is not possible in many practical applications 
and thus, the reported results for these filters are optimistic. 
For the MM-A-prj-CPHD filter and similarly for our bootstrap 
(B-MM-CPHD) filter, the clutter rate and detection probability 
are adaptively estimated using our proposed framework. 

To ensure the validity of our experiments, for the inde¬ 
pendently implemented tracking methods such as MHT, P- 
Tracker and U-Tracker, we attempted to either estimate their 
parameters from the ground truth or to find the values that 
resulted in their best performance. Moreover, the multiple mo¬ 
tion model implementation of all competing tracking methods 
was used. For the IMM-JPDA and different PHD and CPHD 
filters, we chose identical state and measurement vectors and 
dynamic models. We modeled the state of each particle by 
its position, Xx,Xy, and velocity, Xx,Xy. The measurements 
vector also contained the estimated position of the particles as 
z = {xx, Xy). To model maneuvering motion of particles, two 
linear dynamics including random walk and small acceleration 
motion models were used Sin. 

Since the target dynamics and measurement models in this 
application can be properly expressed by multiple linear and 
Gaussian terms, we used the Gaussian mixture implementa¬ 
tion il and the Beta-Gaussian mixture approach S for 
analytical implementations of the MM-CPHD and MM-X-po- 
CPHD filters, respectively. The birth intensity distribution 7 ( ) 


^The performance of the first three trackers, P-Tracker, U-Tracker and MHT, 
has been evaluated in a recent particle tracking challenge and their results have 
been reported in According to this article, they can be assumed as three 
top performing methods for similar applications. 
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for all the PHD and CPHD filters was set as a Gaussian 
distribution centered at the image with a very high standard 
deviation S. 

As previously discussed, the PHD and CPHD filters prop¬ 
agate the intensity distribution of all targets Vk(x) in each 
time frame k. By calculating the estimated number of targets 
Nk, the state of all targets in each time frame can be 
easily extracted using Vk{x) EElilliM However, in this 
filtering framework, the temporal correspondences between 
the estimated states is not considered. In other words, the 
output of the PHD and CPHD filters is a set of the estimated 
states for each time frame without considering the identity of 
trajectories. Thus, the dynamics of an individual target cannot 
be evaluated. To deal with this, some authors combine the 
PHD filter with a track management technique to maintain 
the identity of tracks S Wh . To avoid any computational 
burden due to a track management step, we simply use our tag 
propagation scheme Q, which only propagates the identity 
of the intensity distributions for all the PHD and CPHD 
filters. As it only considers the previous time step to propagate 
the identities lllhll . this is not the most reliable approach for 
identity-to-track assignment. However, since we are interested 
in the overall, not individual, motion of the vesicles, we used 
this approach in this application. 


B. Evaluation Metric 

To qualitatively assess the performance of these tracking 
methods, we used a recent and popular metric based on 
optimal sub-pattern assignment (OSPA) followed by an 
extension of this metric for multi-target tracking applications, 
known as OSPA-T 1^ . 

1) OSPA Metric: This metric measures the distance be¬ 
tween two sets of points, which can be the set of estimated 
tracks and the ground truth tracks at each time frame, and rep¬ 
resents different aspects of multi-target tracking performance 
such as track accuracy, track truncation and missed or false 
tracks by a single value. 

For two arbitrary sets X = {xi,...,Xm} and Y = 
{yi, where m < n, the metric of order p is defined as 

( -. m \p 

-(mm^dp(a;i,yeJP-f c^(n-TO))j , (26) 

where 0„ is all feasible sets of permutations on Y and 

dpix,y) =m.m{c,\\x-y\\p), (27) 

where c > 0 is the cut-off parameter. For m > n, Dp{Y,X) 
is calculated, instead. 

In Eq. |26] the first term, known as the location error, 
measures track accuracy while the second term, the so called 
cardinality error, represents the error for missed or false tracks. 
In this metric, the parameter p controls the sensitivity to outlier 
estimates that are distant from the true targets. Moreover, the 
metric penalizes the cardinality error by the cut-off parameter 

^For example, in the Gaussian mixture implementations, the mean of 
Nk Gaussian terms with the highest weights in vNx) can be used as the 
estimation of the state vector at each time frame 14311. 


c as a higher value for this parameter penalizes the false and 
missing targets more. At a first glance, the selection of the 
parameters c and p seems to be critical for the performance 
of different methods. However, it was proved that the relation 
between the performance of different methods is independent 
of the parameters c and p and different values for these 
parameters only change the scale of the error, and do not affect 
the method ranking 14811 . 

2) OSPA-T: Although the OSPA metric measures the multi¬ 
target tracking errors such as track accuracy and missed or 
false tracks, it does not evaluate some other errors such as 
inconsistent labeling (label switching between the targets in 
crossing cases) and incorrect label initiation in the case of 
track truncation. An extension of the OSPA metric, known as 
OSPA- tS considers the aforementioned errors by measuring 
the distance between two sets of labeled points. 

Let us assume that we have two labeled sets such that 
X — {(/i,xi), ..., {Ijrii ‘t'TTi)} and Y — Vn) ^ ■ 

In a multi-target tracking problem, these would be the ground 
truth and estimated state of the targets with their labels in 
each time frame. In this performance measure, the label 
correspondence between the estimated and ground truth sets is 
first performed based on an optimal global assignment using 
the trajectories’ temporal information Then, dp{x,y) in 
Eq. |26] is substituted by the following distance. 

4 ^-') ((Z,x),(Z,y)) = (28) 

min ^c, - y||P-f 

where Fs{l, 1) = 0 if I and I are the corresponding labels, and 
Ps{i,j) = 1 otherwise. The parameter I should be between 0 
and c and controls the penalty assigned to the labeling error. 
The case £ = 0 assigns no penalty, and I = c assigns the 
maximum penalty. In this paper, we reported the results with 
I = c. 


C. Evaluation on synthetic data 

To quantitatively evaluate the tracking algorithms, they were 
first evaluated using 10 realistic synthetic movies generated 
by the framework proposed in S. The sequences simulated 
using this framework reflect the difficulties existing in real 
TIRFM sequences while providing accurate ground truth. In 
these sequences, the aim is to mimic the effect of the injection 
of a stimulus such as insulin into a pancreatic cell. Eig.|5]shows 
two frames of the synthetic sequences using this framework 
which are comparable with the real TIRFM sequences shown 
in Fig. [T] 

Each synthetic sequence was simulated with spatial res¬ 
olution of 158nm/pixel and temporal resolution 10 fps and 
consists of time-varying number of targets (on average sa 190 
particles per frame) moving through 60 time frames inside 
a cell membrane (an estimated background) that is extracted 
from real TIRFM sequences with effective region sa 230 x 230 
pixels. The spots were generated in different sizes, Ri 1.2 —4.5 

^Contrary to the OSPA, the OSPA-T is not a metric in the formal 
mathematical sense. However, it can be used as a performance measure. 
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Fig. 5. Two frames of the synthetic TIRFM sequences generated by the 
framework proposed in na. 

pixels (200 — 700 nm). The dynamics of the targets were 
modeled using random walk and linear movement. Further¬ 
more, targets can switch between these two dynamics. The 
number of intersecting and touching spots in each frame 
was counted according to the Rayleigh resolution m. The 
averaged percentage of intersecting and touching spots per 
frame in these sequences is equal to 1.2%. 

Due to the 3-D motion of the structures, their intensity 
changes according to the TIRFM exponential equation 0. 
Therefore, they may either temporarily or permanently disap¬ 
pear from the frames. New born targets may also gradually 
appear from the background. The sequences are contaminated 
with Poisson noise and the main characteristics of the se¬ 
quences such as background intensity and noise level gradually 
change based on a model extracted from real sequences. Due 
to spatio-temporally varying noise level and backgrounds and 
dynamic intensity of spots, the signal-to-noise ratio (SNRf| of 
an object cannot be constant. Instead, it varies between 1 and 
9. 

Similar to the real TIRFM data, the spots in the synthetic 
sequences fade over time as noise level and background 
intensity gradually increases. From a biological perspective, it 
is important to assess the dynamics of vesicles after injection 
of the stimulus which leads the escalation of noise level and 
background intensity. Therefore, the threshold in the detection 
method needs to be set low to ensure consistent detections 
of the objects in order to avoid early track termination. To 
this end, we chose a value for the threshold such that the 
averaged detection probability for all sequences pu is about 
0.9. However, this scenario noticeably increases the clutter rate 
and its variation over time. Fig. |6] shows that the mean clutter 
rate estimated using the proposed MM-A-pu-CPHD hlter can 
appropriately follow the quick changes in the ground truth 
clutter rate. 

In this experiment, the performance of the trackers was eval¬ 
uated using these time-varying and highly cluttered detections 
and their results are reported in Table|T] In this Table, the errors 
are averaged over the number of frames in all 10 synthetic 

®SNR value is used for re pres enting the level of noise and is calculated 
using definition of Smal et al. 1221 which is the difference in intensity between 
the object and the background, divided by the standard deviation of the object 
noise. 



Fig. 6. The ground truth, averaged and estimated (using the proposed MM- 
A-pij-CPHD filter) clutter rates for a synthetic image sequence in the high 
clutter scenaiio (po = 0.88 and A = 112). 


sequences. The results show that our bootstrap hlter benehts 
from a reliable estimator, the MM-A-pri-CPHD hlter, which 
accurately estimates the detection probability and clutter rate. 
Consequently compared to the other tracker, its tracking results 
contain fewer false and missing tracks, which decreases the 
cardinality error signihcantly. Similarly, this error is also low 
in the MM-A-pu-CPHD hlter. The other Bayesian trackers 
cannot beneht from these estimations as their parameters 
are hxed. Therefore, they have higher cardinality error. In 
comparison with traditional Bayesian trackers such as the 
IMM-JPDA and MHT trackers, the RFS hlters have relatively 
better cardinality error as they properly incorporate birth, death 
and clutter models in their formulations. However, the higher 
difference between the OSPA and OSPA-T errors of the all 
RFS hlters represent that their results include more identity 
switch errors compared to the other trackers due to the simple 
tag propagation scheme used. 

The performance of the P-tracker as one of the deterministic 
trackers seems to be sensitive to cluttered measurements. 
Therefore, it has the highest cardinality error of the trackers. 
In contrast, the results show that another deterministic tracking 
scheme, U-tracker, can robustly track the particles while 
dealing with highly cluttered detections. 

The P-Tracker has the lowest location error of all trackers. 
Although this error reflects the accuracy of the trackers in 
tracking particles, its lower value can be also an artifact 
of the tracker’s poor performance. The trackers with higher 
cardinality error have relatively lower location error and vice 
versa. 

The method rankings may change in other scenarios, e.g. 
where the clutter rate is low and its variation over time can 
be ignored. In our application, the clutter rate and its varia¬ 
tion over time can be decreased by increasing the detection 
threshold value. For example, we chose a value such that 
the averaged clutter rate A and detection probability pu are 
respectively about 11 and 0.7. In this case, the detected points 
from a target are inconsistent and many faint particles are not 
detected after initial time frames. This case is undesirable for 
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Fig. 7. The ground truth, averaged and estimated (using the proposed MM- 
A-p£)-CPHD filter) detection probability_ for a synthetic image sequence in 
the low clutter scenario (pjy =0.7 and A = 11). 

our application due to many truncated tracks with short life 
time. Nevertheless, we report the tracker’s OSPA and OSPA-T 
errors in this case in Tablellllin order to compare their different 
performance in the low and high clutter rate scenarios. Note 
that both false tracks in high clutter scenario and missed or 
truncated tracks in low clutter scenario increase the OSPA and 
OSPA-T errors. 

The results show that the trackers such as the IMM-JPDA 
hlter and P-Tracker which have the worst performance in 
highly cluttered measurements perform better for a low clutter 
rate with long missed detections compared to other trackers. 
In contrast, the U-Tracker cannot perform reliably in this case 
as it has the highest cardinality error. Estimating declining 
trend in the detection probability (Fig. |7]i helps our bootstrap 
tracker to still have lower OSPA error compared to the other 
trackers, but relatively high OSPA-T error due to the simple 
tag propagation scheme. 

In a nutshell, the performance of the trackers varies ac¬ 
cording to the detector reliability. Our bootstrap approach has 
superior performance for highly cluttered detections with the 
time-varying rates. 


TABLE I 

The averaged location, cardinality, OSPA and OSPA-T errors 

OF THE TRACKERS IN PIXEL WITH THE METRIC PARAMETERS p = 1 AND 
C = £ = 10 (PIXEL) FOR THE 10 SYNTHETIC SEQUENCES IN THE HIGH 
CLUTTER SCENARIO {po = 0.88 AND A = 112). 


Method 

Location 

Cardinality 

OSPA 

OSPA-T 

B-MM-CPHD 

2.52 

0.56 

3.08 

5.41 

MM-A-pd-CPHD 

2.64 

0.63 

3.27 

5.48 

MM-CPHD 

2.39 

1.12 

3.51 

5.50 

MM-PHD [1^ 

2.71 

1.30 

4.01 

6.55 

IMM-IPDA |T9j 

1.54 

2.68 

4.22 

5.72 

MHT [1^ 

1.71 

2.23 

3.94 

5.67 

P-Tracker 

1.33 

2.70 

4.03 

6.50 

U-Tracker [A| 

1.85 

1.43 

3.28 

5.04 


D. Evaluation on real data 

The tracking methods were also tested on a real TIRFM se¬ 
quence with spatial and temporal resolution of si 150nm/pixel 
and 10 fps respectively. The image sequences were acquired 
from a pancreatic beta cell injected by insulin during the 
acquisition. 

In order to prepare a ground truth, an independent expert 
manually tracked all visible structures (332 trajectories from 
21752 spots) in a part of the cell within 500 time frames using 
the freely available software MTrackJ ifs^l . The annotated tra¬ 
jectories were double-checked by another biologist to ensure 
reliability of the ground truth. 

In order to detect and track all structures, especially after 
injection of insulin, the threshold in the detection method was 
set low, which noticeably increases clutter rate and its variation 
over time (Fig. [8]l. The results of the trackers for the real data 
are reported in Table HII] In this Table, the errors are averaged 
over the number of time steps in the real image sequence. 

The higher clutter rate along with significantly higher num¬ 
ber of time frames and numerous faint structures existing in 
real sequences cause higher values of the OSPA and OSPA- 
T errors of the all trackers for real sequences compared to 
the synthetic data. In addition, the results confirm our argu¬ 
ments about the performance of the trackers in the synthetic 
sequences for the same high clutter scenario. The ability of our 
B-MM-CPHD to properly track true targets while accurately 
estimating the clutter rate and detection probability (Fig. B 
leads to the lowest cardinality and also OSPA errors. 

Since there were always faint structures in real sequences 
that even experienced annotators were unable to detect or 
determine whether they are real or false targets, the reliability 
of the manual ground truth cannot be completely guaranteed. 
In this case, the quantitative results may be biased to a specific 
method. To maximize the validity of our comparison, the 
results of the tracking were also visually assessed by the 
experts. This assessment also showed that our bootstrap filter 
can better detect and track the real vesicles, especially faint 
ones, while avoiding tracking false targets. 

In Fig.|9](a), the tracking results of several crossing particles 
with maneuvering motions using the proposed bootstrap filter 

TABLE II 

The AVERAGED LOCATION, CARDINALITY, OSPA AND OSPA-T ERRORS 
OF THE TRACKERS IN PIXEL WITH THE METRIC PARAMETERS p = 1 AND 

C = £ = 10 (PIXEL) FOR THE 10 SYNTHETIC SEQUENCES IN THE LOW 
CLUTTER SCENARIO {po = 0.7 AND A = 11). 


Method 

Location 

Cardinality 

OSPA 

OSPA-T 

B-MM-CPHD 

2.71 

0.68 

3.39 

5.39 

MM-A-pd-CPHD 

2.78 

0.82 

3.60 

5.97 

MM-CPHD 

2.84 

0.79 

3.63 

5.61 

MM-PHD |4^ 

2.90 

1.08 

3.98 

6.01 

IMM-IPDA |T9j 

1.37 

1.67 

3.04 

4.21 

MHT |T4| 

0.81 

3.07 

3.88 

5.48 

P-Tracker 

0.85 

2.55 

3.40 

5.20 

U-Tracker [4| 

0.64 

3.36 

4.00 

4.93 
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Fig. 8. The ground truth, averaged and estimated (a) clutter rate and (b) detection probability using the proposed MM-A-p£)-CPHD filter for the real image 
sequence. 


are shown. The results show that it can properly deal with 
the maneuvering motion of the targets. However, the results 
are not error free and include some missing and false tracks 
and switching labeling errors. Fig. |9](b) also demonstrates the 
performance of our proposed bootstrap hlter in tracking two 
faint particles moving through the synthetic and real sequences 
with time-varying background and noise level. 

V. Conclusion 

The estimation of clutter rate and detection probability 
helps improve tracking of the targets in particle tracking 
applications where measurements include many spurious and 
missed detections with unknown and time-varying parameters. 
The RFS framework provides a principled solution to deal with 
the estimation of these parameters which was not possible 
in previous approaches. The A-pu-CPHD hlter is one of the 
hlters derived based on RFS theory which is able to estimate 
these parameters. However, the hlter cannot naturally perform 
as well as the CPHD hlter with known parameters. To this end, 
in this paper we proposed a bootstrap hlter by combination 
of the CPHD and A-pc-CPHD hlters. To accommodate the 
maneuvering motion, we also proposed a multiple model 
implementation of the hlters. Therefore, the clutter rate and 
detection probability are estimated by the multiple model A- 
P£)-CPHD hlter bootstrapped onto a multiple model CPHD 
hlter that outputs target estimates. 

The proposed approach was evaluated on a challenging 
particle tracking application where vesicles move in noisy 
sequences of total internal rehection huorescence microscopy 
while the noise characteristic and background intensity of 
the sequences change during the acquisition process. In this 
application which the clutter rate and detection probability are 
time-varying, we demonstrated that our bootstrap hlter is able 
to better track the real targets and more reliably avoid false 
tracks compared to the other RFS hlters such as the MM- 
PHD, MM-CPHD and MM-A-po-CPHD as well as other state- 
of-the-art particle tracking methods such as the IMM-JPDA, 


MHT, P-Tracker and U-Tracker in both synthetic and real 
sequences. However, in the applications where the motion of 
each individual targets is required, the tag propagation scheme 
may need to be chan ged to a track management algorithm, 
e.g., that proposed in |4^ £7] or more generally, the tracker 
in the bootstrap hlter can be replaced by any multi-target 
tracker that requires knowledge of false alarm and detection 
rate and performs reliably in the label assignments. In the RFS 
concept, a principled solution to the track labeling problem 
using labeled RFS has been recently proposed which can 
be also used for this purpose. 


Obviously, our approach may not be a good choice for some 
applications. For example, in the cases where the particles 
can be easily detected or the rates for false alarms and 
missed detections are negligible, known or time-invariant, 
there is no point to adaptively estimate the clutter rate and the 
detection prohle. In addition, to estimate these time-varying 
rates, the MM-A-pu-CPHD requires some probabilistic priors 
describing how the clutter rate and the detection probability 
change over time S. Therefore, this approach requires more 
parameters compared to other trackers. Moreover, the boot¬ 
strap method hlters twice in each frame in order to estimate 
the state of the targets. Consequently, its processing time is 
more than each of its component hlters, MM-A-pu-CPHD and 
MM-CPHD. Our non-optimized MATLAB code was run on 
an ordinary PC (Intel Core 2 Quad, 2.66 GHz CPU, 8 GB 
RAM). The average CPU processing time per frame per target 
in the highest considered clutter rate (around 280 detected 
positions per frame) for the multiple model CPHD, X-po- 
CPHD and our bootstrap hlter are about 17.1ms, 8.0ms and 
25.1ms respectively. 


Due to linearity of the dynamic and measurement models 
in our application, we only used the multiple model Gaussian 
linear implementation of all hlters. The recursive equations 
derived in the appendices can be used for both Gaussian linear 
and non-Gaussian non-linear system models. In order to apply 
the proposed framework to applications with non-linear non- 
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Fig. 9. Some examples of tracked vesicles using the proposed bootstrap filter (dashed line) against the ground truth (solid line) in the synthetic and real 
TIRFM sequences, (a) The tracking results of multiple crossing particles with maneuvering motions in the synthetic TIRFM sequences, (b) The resulting 
trajectory of two faint vesicles from the synthetic (Top row) and real (Bottom row) TIRFM sequences in different time frames. For an improved visualization, 
the other tracks are eliminated. These particles move in different background intensity and noise level. 


Gaussian system models, the sequential Monte Carlo (SMC) 
implementation of the filters is required. This implementation 
will also allows us to further evaluate the performance of our 
bootstrap filter and compare it against the SMC-PHD El, 
SMC-CPHD I3J.I and the traditional particle hlters. 


Appendix 


For completeness, we now derive the recursive equations 
for both the multiple model CPHD and A-pu-CPHD filters in 
this section. The following notations are used in throughout 
this Appendix. The binomial and permutation coefficients are 
denoted by Cj and P^, respectively. (•, •) is the inner product 
operation between two continuous or two discrete functions. 
The elementary symmetric function of order j defined for a 
finite set Z of real numbers is denoted by 


s<zz,\s\=j Vees / 


(29) 


where jS”! is the cardinality of a set S and eo(Z) 


1 m- 


TABLE III 

The averaged location, cardinality, OSPA and OSPA-T errors 
OF the trackers 


in pixel with the metric parameters p = 1 and c = £ = 10 (pixel) for a real 
_ image sequence. _ 


Method 

Location 

Cardinality 

OSPA 

OSPA-T 

B-MM-CPHD 

3.91 

1.04 

4.95 

6.30 

MM-A-pd-CPHD 

4.01 

1.23 

5.24 

6.56 

MM-CPHD 

3.92 

2.07 

5.99 

7.23 

MM-PHD [1^ 

4.05 

2.23 

6.28 

7.64 

IMM-JPDA |T9) 

0.93 

5.75 

6.68 

7.25 

MHT [1^ 

1.21 

4.28 

5.49 

6.33 

P-Tracker 

0.55 

5.45 

6.00 

7.32 

U-Tracker [4| 

1.96 

3.63 

5.59 

6.44 


A. Multiple Model CPHD Recursions 

Prediction step: Suppose at time fc — 1, the posterior 
cardinality distribution pk-i and posterior intensity 
are known. The predicted cardinality distribution Pk\k-i and 
predicted intensity v_k\k-i are calculated by 

n 

Pk\k-i{n) = (30) 

j=0 


Uklk-ii^^r) =7(a:)7r(r) + 




(31) 


where U[vk_i, pk-i]{j) = 


Y^cipk-iiiy-^ 

l=j 


y,iLk-iy~^ 


(32) 


Note that in the multiple model approach, the inner product 
function operates on both the kinematic state and the model, 
i-e- (Fs,Wfc-i) =J2f IPsy,r)vk_i{x,r)dx. 

Update step: If at time k, the predicted cardinality distribu¬ 
tion pk\k-i, predicted intensity and set of measurement 

Zk are given, the updated cardinality distribution pk and 
updated intensity y_k are calculated by 


'Y'O 

—k 1 fc — 17 

(n-)Pfcifc-i(ti) 

(i 

•'0 

—k 1 fc — 17 

,Pk\k-l^ 


(33) 


lLk{x,r) =Vk\k-i{x,r)x 

y-Pjj{x,r))- 


{l} 

P-k\k-n Zk 

j Pk\k-l'j 

(x° 

P-k\k-n Zk 

) Pk\k-l'j 




-'Y' i 


lk\k 


-l,Zk\z 


yPk\k-l 


zGZk 


'Y'U 


P.k\k-l^ Zk 


) Pk\k-1 


( 34 ) 
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where 


(n) 


min(|Zfc|,ri) 

^ {\Z^\-j)\pK{\Zk\-3)Pf+^ 

3=0 


where 


: 3 e Zfcj , (36) 


t^ix,r) = ^^^^9{z\x,r)p^{x,r). 


B. Multiple Model X-pD-CPHD Recursions 

Prediction step: Suppose at time fc—1, the hybrid cardinality 
distributions pk-i and the posterior intensity distribution for 
actual targets ^^'d clutter generators are given. The 
hybrid predicted cardinality distribution /9fe|fe_i and predicted 
intensity for actual targets and clutter generators 

are calculated by 

h oo 

Pk\k-i{n) = '^pv{n - j)'^C]pk-i{l){l - 4>y~^4>^ 

3=0 1=3 


where 


1=3 

(38) 

v) + ^s\^k-i)\ 
l) + (1.Ii1-i) /’ 

(39) 

l7r(r)-|- 


[x, r)x 


\r\r)v^j^\{x,d,r)dxdd , 

(40) 

'(&) 

(41) 


Update step: If at time k, the predicted intensity for actual 
targets the predicted intensity for clutter generators 

predicted hybrid cardinality distribution pk\k-i 
and set of measurement Zk are all given and the function 
X” (ri) defined as follows: 




n < \Zk\ + ■ 


n>\Zk\+u 


where 


$ = 1 - 


AW „W\ + AW Ao)\ 

^ yi-klk-l^Po / ^ \lLk\k-l^PD j 


1 \ + a 


where p\j\x,a,r) = a and p}j (b) = b. 


The updated cardinality distribution and the updated in¬ 
tensity distribution for actual targets u A and clutter generators 
uA are given as follows 


Pk{n) 


0 h < \Zk\, 

X Vk\k-i^Zk {h)pk\k-i{n) 

n> \Zk\, 

(44) 
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